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Abstract — Formation control is an important problem in 
multi-agent systems. In this paper, it is assumed that a target is 
moving with a disturbed dynamics, and then, a k-coverage 
formation control is designed for every nonholonomic agent to 
improve tracking qualities. A virtual agent approach is adopted in 
the formation control design. The stability of the tracking error 
system is analyzed. Finally, some numerical simulations are given 
to validate the proposed tracking algorithms. 
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I. 



Introduction 



In recent years, formation control problems of multi-agent 
systems have been studied intensely due to its wide 
applications in mobile robotics [1]— [3], air traffic control [4], 
[5], satellite clustering [6], automatic highways [7], and mobile 
sensor networks [8], [9]. The existing approaches to formation 
control generally fall into two categories. The one is the 
leader-follower approach [10], [11] and the other is the virtual 
leader approach [12], [13], The combination of these two 
categories of approaches is adopted in this paper to deal with a 
target tracking problem with nonholonomic agents. 

In many real applications, the leader or target is moving 
with a disturbed dynamics. When the target dynamics is 
completely unknown, random walk model can be used. Thus, it 
is crucial to design a feasible target tracking algorithm. It is 
well known that some tracking filters, for example, the 
extended Kalman filter (EKF), unscented Kalman filter (UKF), 
particle filter (PF), have been developed for nonlinear target 
dynamics. However, most filters suffer from convergence 
guarantees [14] and tracking qualities [15]. Especially, the 
integration of tracking filter (such as EKF) and formation 
control improves the tracking performance effectively [15]. 

Inspired by the observation, we focus on giving a thorough 
investigation of formation control in target tracking in this 
paper. The trajectory of the target is assumed partially 
unknown, which is described by an exogenous system. The 
dynamics of all mobile agents are second-order nonholonomic 
systems. A requirement on the formation controls of all agents 
is to ensure that the target is monitored by at least k agents at 
any time, which is called a k-coverage problem [16]. When the 
target and agents are restricted in a second-dimensional plane, a 
neighbor-based formation controller is proposed for each agent 
to achieve an equilateral-triangle deployment and, thus, solve 
the 3-coverage formation control problem. 



The rest of the paper is organized as follows. In Section 2, a 
target tracking problem is formulated with some graph 
preliminaries. In Section 3, k-coverage formation controllers 
are designed to solve the 3-corverage target tracking problem. 
The stability of the tracking error system is analyzed in Section 
4. Finally, some numerical results are given to validate the 
proposed tracking algorithms in Section 5. 



II. 



PROBLEM FORMATION 



In this section, a target tracking problem is formulated for a 
group of autonomous mobile agents. 

Consider N agents and a target with partially unknown 
dynamics in a second dimensional tracking region. Each agent 
Q, ={stR 2 ||| s\\-s i <r}, /=!,.. -,JV 



is occupied by a disk ' 
s i =co/(x i ,y i )ei? 2 



where 



is the position vector and r is the 



sensing range of agent i. The interconnection network of the 

agents is described by a directed tree ~~ *• ' , where the 

node set - i>—> > anc j the arc set^ = ^ x ^, which is 
shown as in Fig. 1. The node i represents agent i. The 

arc *• ' ' , if and only if agent i can receive information 
from agent i-1. For convenience, let the target be labeled by 0. 




Fig.l Tree interconnection topology 

The kinematics of each agent is described by a 
nonholonomic nonlinear system with pure rolling and 
nonslipping: 



y s ,i =v s,i sin <Pi> 



i=l,...,N 



(1) 
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where co/(x,.(t),y,(t)) ei ^ v,.,(t) f ^(t) and w,.(t) are 
the position state, translational velocity, angular and angular 

velocity of agent i, respectively. Let ' ~~ *• c "i'^f'be the 
triple coordinate of agent i. Here, the controls to be designed 
v s ,(O and w iW 



are 



Suppose the dynamics of the target is described by a second 
order linear system: 



(2) 



(3) 



'p(0 = q(0, 

14(0 = u(0, 

where " ' " are, respectively, the position, velocity of 

the target, ^ ' is a partially unknown disturbance. The 

disturbance is modelled by a linear exogenous system 

\g(t) = Tg(t), 

[u(t) = Dg{t), 

where r, F, -D are known appropriate dimensional matrices. 
If T t D have negative real-part eigenvalues, the disturbance 
will approach zero as time goes to infinity. Without loss of 
generality, it is assumed that the eigenvalues of r have 
nonnegative real-parts. 

In order to track the target with high quality, k-coverage 
methodology is realized by designing formation controls 

s ' and '^ ' for i=l,...,N. Following the literature on 
formation control [17], the desired formation can be encoded in 
terms of a formation graph. 

Definition 1 (Formation graph): The formation graph 

F ~ *• ' F ' ' is an undirected graph that consists of (i) a set 
of vertices V ={1, ...,N}; (ii) a set of edges, 

F containing pairs of nodes that represent inter-agent 

formation specifications and (iii) a set of desired 

configurations '' that specify the desired inter-agent 

relative position. 

Further, a k-coverage formation requires all agents to 
achieve a desired formation graph and the target is sensed by at 
least k agents, simultaneously. Thus, we say that a k-coverage 

formation problem is solved if ' > ij and a 

bounded k-coverage formation problem is solved if 

z J — z. — d.. < s 
' > 'i for some positive constant e . The objective 

of each agent is to be stabilized to a desired distance and 

angular with respect to its neighboring agents, which solves the 

k-coverage formation problem during the target tracking 

process. 



for agent i at a pre-assigned distance oi and bearing angular ^ oi . 
Let ' denote the actual distance between agent i and agent i-1 
and " f denote the actual bearing angle from the moving 

direction to the adjacent edge < '- 1 (see Fig. 2). The bearing 

„i rif fi„P 0i €[-#,-#/ 2) u {-nl2,nll) 

angles satisfy ' ^"-' K ' 

*■ . Then, the bounded k-coverage formation problem 

is solved if " d l~ d oi < s i> "A ~ Pm <£ 2-f or any positive 

numbers 1 and 2 , as time goes to infinity. 




Fig.2 Notations of angles and distances 



V - W 

Before we design the formation control s '' and ' for 

agent i, a transformation is exerted to system (1) firstly. 



Since 



one has 



d f={ x s,i- x s,i-if + {ys,i-y s ,i-i) 2 



d i = - V S ,i C0S P, + V s,,-l cos (#, + Pi) 

From Fig.2, it can be seen that 

Pi =a-p i -y l , 

(y.j-i-y..i)/ % 



(4) 



y j = arctan( 
where 
Then, 



(x.j-x.j-i) 



Yl = -T V s,i-i sin (^ + Pi ) - -J" v s ,, sin Pi 

d; d : 



(5) 



Pi=-<Pi-Yi 



~ w > ~^~ v s.'-i sin ^' + P ) + T v ",i sin Pi 
d, d : 



Define l =<p t — (p { _ x , one has 



(6) 



III. 



CONTROL DESIGN 



(7) 

Thus, from (4), (5) and (6), system (1) is transformed to a 
new version: 



,v s ,(0 



l w /W ir 



In this section, formation controllers S|W and "'^in (1) 
for i=l... N, are designed based on the path-following control 
algorithm presented in [12]. 

c ° ° i 
A reference point •**■* s *'' is chosen as the virtual agent 



d i = - V s,i C0S Pi + V s,i-1 cos^i + Pi ) 



fit = -w, ~^v S i-i s ™(di +P,) + — v,,, sin fi, 
d, d, 



(8) 
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fori=l,...,N. 

Next, the 



k-coverage formation tracking 



controllers s 'and ' are to be designed for transformed system 
(8). 



Regarding the following fact, 

k°.i=*».i +4,., COS(ft +#,,,) 



X li - X s,i-1 = d 0,i C0S (^ + A,i ) - d i C0S (ft + fit )» 

y°, - y,,i-i = d o,i sm to + A,i)-d, sinfa + A). 

Thus, the formation control (10) is given by 
-(d iC os(# -/?„,) -d ,) 



(13) 



(9) 



one has 



x°,. cosfa + /? 0i ) + y° sj sin(p, + /? 0I ) 



w. 



cos /? , 



-x .sin^.+y .cos^ 



cos/?, 



0,i 



cos/?„ 



-cos((p t +/3 . -(p { _ v ), 



(14) 



w. 



-(d,sin/?,-d 0>l sin/? ol ). 



or, 



d oi cos/J Qi 

f cos(<p, + ol ) sin(ft +/?„,) ^ 



-4 



d 0i c os^ 0i 

However, in many real applications, it is difficult to 
measure the neighbors' velocities. An assumption is made for 
all agents and the target: 



Assumption 1: For agent 



i (i = \-..,N) 



the 



cos/? 0i 
sin <p t 



cos p 0i 
cos <p t 



'*.', 



velocity 



(Kj'KJ 



(10) 



d oi cos/? oi d m cosp oi j 

Remark 1: When the target changes its direction slowly, ^ oi can 
be chosen as constants. However, once the target changes its 
direction very quickly, it is not necessary to require all agents 
to change their directions so quickly as to keep the desired 
formation. In order to reduce the response time of the whole 
group, the formation of agents can change the direction in a 
smooth way according to the following dynamics designed for 

the desired bearing angle ""•' : 

if . v." < //. 

A,H-7t4tt V 



is bounded by 

yj*s,i+yli ^ v s, 
for some positive number s . For the target, the 



velocity 



(Wo) 



is bounded by 



M+y~o ^ V g 



for some positive number 9 . 

Under Assumption 1, we ignore the velocity of agent i-1 in 
(12), then one has 



-2 -2 



1+ fit) 
P 
1+ fit) 



x y -y x . „ 

•2,-2 r& : 



otherewise. 



(11) 



Then, simplified formation controllers are given by 

k 



(15) 



fit) 



where ^ o>/o^ j s the position of the target, ' v "' is an 
appropriate monotone increasing function with respect to t, the 

threshold " and the scaling factor ~ " ~ . 

■0 -0 

Furthermore, if s '' , Si ' are choose as 



cos/3 0i 
k 



w. =■ 



d ot cos J3 . 



(d,.cos(#-/? ,)-d ,) 
(d. sin J3.-d . sin J3 .)-fi 0A 



(16) 



/v 



y, ,i=- fc i(y,°j-y,.i-i)+y..i-r 



(12) 



where ' are some positive gains for i=l,...,N, agent i will 
approach virtual agent i as time goes to infinity. Note that when 

(v-i.y,.f-i), 



i=l, 



will be the position vector of the target. 



Consider the relationship between sl x S! x and 
one has 



(«) 



where the dynamics of °' is given in (11). 

IV. STABILITY ANALYSIS 

In this section, some main results are established for the 
formation stability. 

Theorem 1: For a group of autonomous agents with kinematics 
(1) and a target with disturbed dynamics (2) and (3), if 
formation control (14) is applied to each agent, then, for any 

initial values A<°> and ^< (0) &-*,-*! 2) u 

(-;r/2,;r/2)u(;r/2,;r]), t , , „ f K1 

v ' v >j/> me k-coverage formation problem is 

solved, that is, 
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d t -d v ^O t /? f -/? ,->o 



Proof: For system (12), let 6 " XsJ X$ - 1 - 1 ' 



validate the proposed target tracking algorithms (14) and (16). 
Given the exogenous system 



e' =y°-y -, 

y J s,i J s,i-l 



then 



$■■ 



1 



®I 2 g, 



(19) 



|e' =y°.-v . . =-k.e\ 

Then, for any positive gain ' , one has 

lime' (t)=0, limet(t) = 0. 
From the fact: 
d ifi - Je' x (t) 2 +e' y (t) 2 < d, < d, + ^(t) 2 + e ;(t) 2 
dj — d 0l — >■ as t— >co. 



(17) 



one has 



On the other hand, due to the following relationship 
tfo,,sin03 0)i +ft)-e;(t) 



tan(/? f +#>.): 



d 0il cos(^ 0l .+^)-ei(t)' 



lim/?,. =/? 0i . 
one has '-*» ' Thus, the conclusion follows. The proof 

is completed. 

Theorem 2: Under Assumption 1, if formation control (16) is 

applied to each agent, ^ and ^ (0) (*[-*.-*/ 2) u 

(-;r/2,;r/2)u(;r/2,;r]) ,, ,, , , , , 

v y v , then, the bounded k-coverage 

formation problem is solved, that is, 

|d,.-d w |< fl , \fi l -p^\<.s 2 
for positive constants l , 2 as f — * °° . 



u =[I 2 ,0]$-, 

The initial values of the target dynamics are given as 
follows: 

p =(0,0,l,l) T ; ?0 =(0,0,0,-l) T . 

The Heun Method is used to obtain the numerical 
computational scheme for system (8) with step » = 1' 40 _ 

Example 1: Four mobile agents with radius r= l-2 are used 
to track the target and the initial distances, orientation angles, 
bearing angles, desired distances and bearing angles are given 
as follows: 

d 1 (0)=l, d 2 (0) = 2, d 3 (0) = 3; d 4 (0) = 2; ^(0) = ;r/3 , 
p 2 (0) = ;r/4, <p 3 (Q) = /r/6; <p 4 (0) = n 1 3; ^(0) = ^/3, 

/? 2 (0) = -;r/3, J3 3 (0) = xf4, /? 4 (0) = 5;r/7; 

d o,i = 2, d 02 =4, d 03 =4, d BA =4; 

P Q:l {Q) = 7i, /? 02 (0) = -;r/3, /? 03 (0) = ;r/3, /?„ 4 (0) = In 1 3; 

Formation controllers (14) and (16) with 

k = k = k = k =20 
1234 , are used to make the agents form an 

equilateral- triangle formation with respect to the target, 

respectively. From Figs. 3 and 4, the tracking errors of 

d i~ d o.i an A fil-fio.1 



'and 



all approach with controller (14) while 

' °' and ' °' are bounded with controllers (16) in 
Figs. 5 and 6. 



Proof. For system (15), one has 



-K<-K,i-i> 



(18) 



[el=-k t e' y -y s>l _ v 

Under Assumption 1, the velocity of agent i-1 is bounded, 
thus, 



max(v ,v ) 
<|<e^|<(0)|+ \^-^ 




Fig. 3 the distance errors evolution with controllers (14) 



max(v ,v ) 



Then, there exists a ^ , for any t>T, one has 
max(v s ,v g ) 



|d\-d ,|< £l =V2 



is thus completed. 



\Pi-Poi\^e t 
, and ' ' . The proof 



V. SIMULATION RESULTS 

In this section, some numerical simulations are presented to 




Fig.4 the bearing errors evolution with controllers (14) 



JCET Vol.1 No.l July 2011 PP.6-10 www.ijcet.org ©World Academic Publishing 



Journal of Control Engineering and Technology (JCET) 



Fig.5 the distance errors evolution with controllers (16) 




Fig.6 the bearing angle errors evolution with controllers (16) 

Example 2: Controllers (16) is used to track the target under the 
following situations: 



(1) 



Au=o. 



(2) °' is described in (11) with " ' . The initial values 
the same as given in Example 1. 



m 



vjW : 



' w 



Fig.7 The formation control with the target (the red line) with 



A,,=o 






Fig.8 The formation control with the target (the red line) under Remark 1 

From Figs. 7 and 8, it is found that the tracking trajectories 
of four agents with dynamic °' are smoother than that with a 
constant "■' . 



VI. Conclusions 

In this paper, a target tracking problem with a group of 
nonholonomic agents was solved by proposing an 
equilateral-triangle neighbor-based formation control to 
improve the tracking performance. The formation stability was 
analyzed with a virtual agent method. Simulation results were 
provided to verify the proposed tracking algorithms. 
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